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(Cached Access to Stored Pages with Easy 
Retrieval), offers a reduction in accessing 
times to the user and also a reduction in net- 
work traffic. 
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INFORMATION RETRIEVAL IN CACHE DATABASE 

The present invention relates to methods and/or systems for accessing information 
by means of a communication system. 

The Internet is a known communications system based on a plurality of separate 
communications networks connected together. It provides a rich source of 
information from many different providers but this very richness creates a problem 
•n accessing specific information as there is no central monitoring and control. 



In 1982, the volume of scientific, corporate and technical information was doubling 
every five years. By 1988, it was doubling every 2.2 years and by 1992 every 1.6 
years. With the expansion of the Internet and other networks the rate of increase 
will continue to increase. Key to the viability of such networks will be the ability 
1 5 to manage the information and provide users with the information they want, when 
they want it. 

Navigating the information available over the Internet is made possible by the use 
of browsers and languages such as Hypertext Markup Language (HTML). For 
20 instance, the familiar Worldwide Web (WWW) is an area of the Internet which can 
be browsed using Hypertext links between documents. 

In co-pending international patent application number GB96/00132. there is 
disclosed a system for accessing information, for instance by means of the 

25 Internet, based on a community of intelligent software agents which store meta 
information about pages on the Internet. The agent-based access system uses 
keyword sets to locate information of interest to a particular user. It also stores 
user profiles such that pages being stored by one user can be notified to another 
whose profile indicates potential interest. The disclosure of the patent 

30 specification for this co-pending patent application is incorporated herein by 
reference. 
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According to a first aspect of the present invention, there is provided an 
information access system, for accessing information accessible by means of a 
communications network, the access system comprising: 

a) means for downloading items of information from the network to local 
5 storage; and 

b) an information processor for processing items of information to locate 
embedded links to other items of information accessible over the network; 

wherein said information processor comprises: 
10 i) a queuing arrangement for queuing items of information having such links 

embedded; and 

ii) a "set of concurrently activatable information acquisition units 

the processor, in use, processing items of information to identify links embedded 
1 5 therein which identify information for downloading, and allocatin g identified links 
to respective available aquisitionjjnit^each acquisition unit then acting to 
download an item of information identified by a link allocated to it, from the 
network to the local storage. 

20 An advantage of embodiments of the present invention is that delays in accessing 
information pages can be reduced. It can also be the case that network traffic is 
reduced since pages are only retrieved once across the network. Subsequent 
access by a user can be to the local storage. 

25 Preferably, the local storage comprises m ore than one cache data store, a first 
cache data store holding items of information which have been retrieved by the 
system and a second cache data store holding items of information transferred out 
of the first cache data store when a user has requested access. The second 
cache data store can then be managed in a different way from the first, for 

30 instance to provide information which is accessed relatively frequently by users. 
The fi^st cache data store may for instance be significantly smaller and be 
"pruned" to hold only information downloaded for links embedded in pages very 
recently requested by users. 
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In general, embodiments of the present invention will need monitoring and 
scheduling capabilities in order to control the queueing process. Otherwise, the 
queue may become a processing bottleneck. 

According to a second aspect of the present invention, there is provided a method 
of storing items of information accessible by means of a communications network, 
which method comprises the following steps: 

) processing an item of information to locate one or more links to other 

terns of information embedded therein, to be downloaded; and 
i) downloading said one or more other items of information by means of said 

network to a local data store. 



An information access system according to an embodiment of the present 
5 invention will now be described, by way of example only, with reference to the 
accompanying Figures, wherein: 

Figure 1 shows an environment in which the information access system is 
supported; 

0 Figure 2 shows a flow diagram of the overall operation of the information access 
system; 

Figure 3 shows a block diagram of the components of a lookahead processor in the 
information access system of Figure 1 ; 



25 Figure 4 shows a flow diagram for the process that is provided by the lookahead 
processor of the information access sytem; 

Figure 5 shows a processing queue and the relevant information acquisition units; 
Figure 6 shows the queue and units of Figure 5 after a time interval has passed; 
and 

30 Figure 7 shows an alternative flow diagram with respect to that of Figure 2. 

The specific embodiment of the present invention described below is referred to 
herein as "Casper", standing for "Cached Access to Stored Pages with Easy 
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Retrieval". The Casper system is particularly designed for accessing Worldwide 
Web pages provided over the Internet Global Communications network. Other 
embodiments of the invention of course could however be used to access other 
information systems where data units ("items of information") have embedded 
5 links to other data units. 



Information accessible by means of the Web is provided as pages in HTML. Within 
a document, strings of words or other identifiers may be highlighted. If the user, 
while viewing a document, selects a highlighted string of words or an identifier, 
10 and clicks on it using the mouse button, the highlighted text provides a link to 

another document. Clicking on the highlighted text triggers the system into calling 
up the relevant document over the Internet for viewing on the user's screen. It 
replaces the document the user was previously viewing. 



15 In the above mentioned co-pending patent application, a system is described which 
can be used to store meta information about pages selected over the Internet by 
clicking on Hypertext links. By using keywords sets, the system alerts other 
interested users in a user group of a new document for which meta information 
has been stored. 

20 

In a Casper system, according to an embodiment of the present invention, when a 
page is selected, for instance to have its meta information stored, the system will 
automatically review that page for HyperText links to other documents available 
over the Internet. If there are such links in the document, and the linked 
25 documents are not already stored locally, then the Casper system enters the new 
page to a page processing queue. The links from the page are then allocated to 
page acquisition software units, as they become available. The linked document 
for each link in turn is then read into a local "look ahead" cache datastore. 



30 This has the effect of putting together a local store of pages which are clearly 
related to pages that the user has an interest in. When the user decides to go 
beyond a page originally accessed, they can simply get the related pages from their 
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local data cache, rather than calling in links on the Internet. This makes 
information retrieval faster for the user and reduces traffic on the Internet. 

Referring to Figure 1, the hardware/software environment which will support 
5 embodiments of the present invention comprises the following: 

i) a WWW viewer 100 connected via a proxy server 105 to a network such as 
Internet 1 10. 

ii) main and "lookahead" caches 1 20, 1 25 and an associated cache controller 
10 115. 

iii) a "lookahead" processor 130 connected between the cache controller 1 15 and 
the "lookahead" cache 125, and having direct access to the Internet 110. 



The environment supporting Casper is generally of known type. The WWW viewer 
15 100 provides browsing capability in respect of the Internet 1 10 via the proxy 

server 105. The proxy server 105 is a known type of software system which can 
intercept requests for information from users' browsers and process them before 
passing them on to the information source on the Internet. The main and 
lookahead caches 1 20, 1 25 are local data stores for storing WWW pages and the 
20 cache controller 1 1 5 provides an interface to them which writes and retrieves 
pages to and from the caches and logs their contents. 

The areas where Casper differs primarily is in the provision of the second cache, 
the lookahead cache 1 25, and in the provision of the lookahead processor 1 30. 



25 



It is known to use a caching server, the cache being a temporary store in which for 
instance pages most recently accessed by a group of users are held. Once the 
cache is full, pages are removed as more recent ones are added. In Casper, there 
is the main cache 120 which stores pages accessed by users. There is also 
30 however the lookahead cache 1 25 which stores pages which havn't themselves 
been accessed but which are linked to pages which have been accessed by users. 
This lookahead each 1 25 is filled by taking the links embedded in pages requested 
by users and downloading the pages for those links. 
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These caches 120,125 then come into use when a user requests a page. Casper 
uses the proxy server 105 to intercept the request in order to make a check first 
as to whether the page is already in the main cache 1 20 or the iookahead cache 
5 1 25. If the page is already present in one of the caches 1 20, 1 25, Casper 
retrieves it from the cache. Otherwise, the relevant information source on the 
Internet must be contacted after all and the page requested from a remote server 
135. 

10 Referring to Figure 2, a flow diagram for the above comprises the following steps: 

STEP 300: the proxy server 105 of the Casper system receives a user request 
300 involving a Universal Resource Locator (URL) at a remote site on the Internet 
such as a remote server 135. The request may be for one of several alternatives. 

1 5 For instance, the user may be requesting to view a page and/or may be requesting 
reloading of a page from the relevant remote server 135 for updating purposes. 
Alternatively, the user may be calling a program which runs dynamically and for 
which caching would be inappropriate. Where a request for a page is made, it may 
incorporate an indication that the cached version of the page is unacceptable and 

20 that therefore the system will have to deliver the page from the originating remote 
server 1 35. 

STEP 305: in order to determine the nature of the request, and any relevant 
constraints, the proxy server 105 reviews the user request. The user request can 
25 contain optional constraints selected by the user, such as "reload" which means a 
cached version of a file is not acceptable, but it may also contain embedded 
constraints, for instance in relation to a URL which it contains. Casper is provided 
with a configuration file that can specify: 

• URLs to be outlawed, for instance because they have dubious content 
30 • URLs that themselves force a network reload, for instance because their content 
is known to change frequently or because the server involved is local or fast and 
caching is therefore inappropriate 
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The request review can th refore take the form of a series of checks such as the 
following: 

• does URL force reload? 

• is URL a permitted location? 

• has user specified reload? 

• has user otherwise specified that a cached version is unacceptable? 

Depending on the outcome, the proxy server will move to either of STEPS 310 or 
330. If the user has clicked on "reload", or the URL forces "reload", then the 
"cached version not acceptable" path to STEP 310 is followed. If the URL is not a 
permitted location, then an "access denied" message is returned to the user and 
no further processing takes place. Otherwise, the "cached version acceptable" 
path to STEP 330 is followed. 

1 5 STEP 310: if at STEP 305, it is found that a cached version is not acceptable, the 
proxy server 105 initiates a connection with the relevant remote server 135. As 
seen in Figure 1, the proxy server 105 has a direct interface to the Internet 1 10. 
In STEP 315, the proxy server 105 checks whether the subject of the request 
exists. If not, in STEPS 320, 355, it generates and delivers a message to the user 

20 appropriately. 

STEP 323: if the subject of the request exists, the proxy server 105 checks 
whether it should be cached. If the subject of the request exists, is an HTML page 
but caching is not relevant, for instance where Casper's configuration file defines 
25 the URL as a forced reload location, then the proxy server will go to STEPS 350, 
355 to trigger the lookahead processor and send the page to the user's browser. 
If the subject of the request exists, is an html page and caching is relevant, the 
proxy server 105 moves to STEP 325 and writes the relevant page to the main 
cache 120. The proxy server 105 will then go to STEPS 350, 355 as above 

30 

It may be the case that neither caching nor lookahead processing is actually 
r levant, for instance in the case of a program which runs dynamically. In that 
case, the proxy server 105 can go to STEPS 350. 355 as above, and the 
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lookahead processor 130 will not find any embedded links to process. On the 
other hand, an extra check can be made (not shown in Figure 2) as to whether 
lookahead processing is relevant. If not, then the proxy server 105 could leave out 
STEPS 350, 355 and simply deliver the program to the user's browser 100. 

5 

STEP 330: if at STEP 305 it is found that caching is relevant, that the user has 
not specified reload or that a cached version is unacceptable, then the proxy server 
1 05 makes a check via the cache controller 115 whether the subject of the 
request, usually a Web page, is in the main cache 1 20. If it is, then the proxy 
10 server is ready to go to STEP 345. 

If a requested Web page is not in the main cache 120, then the proxy server 105 
makes a check via the cache controller 1 1 5 whether it is already in the lookahead 
cache 125. If it is, the proxy server 105 moves to STEP 340 and transfers the 
1 5 page to the main cache 1 20 and is ready to go to STEP 345. 

If the requested Web page is not in the lookahead cache 125 either, then the proxy 
server 105 moves to STEP 310 and follows the process described above for STEP 
310. 

20 

STEP 345: the proxy server fetches the requested page from the main cache 1 20 
and moves to STEP 350, triggering the lookahead processor 1 30. After triggering 
the processor, the proxy server 1 05 moves to STEP 355 where it adds Casper 
page wrappers to the requested page(s) and sends them to the user's browser 
25 100. 

Meanwhile, as further discussed below, the lookahead processor 1 30 reviews the 
requested page(s) to identify embedded links and to access and download to the 
lookahead cache 125 the pages identified by the embedded links. 

30 

Referring to Figure 3, the lookahead processor 130 comprises software processes 
and memory, running on a Unix machine. It comprises three asynchronous 
processes, a page processor 255, a slot processor 260 and a shelf processor 265. 
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The page processor 255 has a message input 200 for receiving messages that will 
for instance contain the URL of a page to be processed, an HTML parser 205 for 
retrieving the contents of a URL and parsing them in sufficient detail to identify all 

5 the HTML links embedded, a link assessor 210 for determining which of the 

identified links need to be "pre-f etched", and a page queue 215 which stores page 
data for processing as processing requests come in to the message input 200. The 
parser 205 and the link assessor 210 both have access to the main cache 120, 
and the link assessor 210 has access to the lookahead cache 125. There is a 

0 timer 235 associated with the page queue 21 5 which marks as "ignore" any links 
which have been waiting too long (a configurable parameter) for processing. This 
provides a mechanism for moderating the length of the page queue. 

The slot processor 260 has the overall purpose of processing the page data in the 
5 page queue 21 5 as quickly as possible. To that end, it is capable of running a 
number of Unix sub-processes in parallel, by means of a plurality of aquisition slots 
225. It is provided with a slot filler 220 which monitors the status of the slots 
225 and attempts to populate any free slots from the page queue 21 5. Each time 
a free slot is newly filled, a connect processor 230 is fired off as a Unix sub- 
0 process to attempt a connection to the server indicated by a URL in an embedded 
link. If successful, a read processor 240 reads the relevant page from the server 
and passes it to a cache writer 245. part of the cache controller 115, which writes 
the data to the lookahead cache 125 and notifies the shelf processor 265. Both 
the connect and read processors 230,240 are provided with timing means 235 to 
5 avoid aquisition slots 225 being tied up inefficiently. 

The shelf processor 265 limits the size of the lookahead cache 125 by removing 
files after a length of time. It maintains a list of files sent to the lookahead cache 
125 by entering file identifiers in time slots in a data store 250 called the "timeout 
shelf". It is provided with a clock 235 which effectively shifts the time slots 
through the data store, each time slot triggering deletion of all its associated files 
from the lookahead cache 1 25 when it reaches the end of the data stor . 
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The maximum permissible length of the page queue and the number of aquisition 
slots are intended to be configurable in order to meet operating conditions. To 
dimension a lookahead processor 1 30, the considerations discussed below are 
relevant. 

5 

Concerning page queue length, there's no serious penalty in software terms in 
making the page queue length arbitrarily long. Curtailing its length does however 
give a measure of control over system performance. The reasoning behind letting 
pages drop off the end of the queue is that where pages which have got to the end 
10 of the queue without being fully processed, the user is anyway likely to have lost 
interest by that time. There is therefore no point in processing those pages 
further. 

A possible initial strategy would therefore be to start with a short page queue and 
15 increase its length until it only rarely overflows. However, if pages are remaining 
on the queue for too long, morei than a minute say, this may be an indication that 
queue length should be reduced. Alternatively, the number of aquisition slots 
should be increased; see below. 

20 The matter is complicated somewhat by the fact that there can be two different 
modes of operation of the lookahead cache, depending on the length of the 
"shelf", ie the permitted lifetime of pages in the lookahead cache. 

If the only purpose of lookahead caching is to give users increased speed of 
25 response during their immediate browsing sessions, then there is no point in 

keeping pages in the cache for more than a few minutes. If pages are kept in the 
lookahead cache for considerably longer, a few days say, then the possibility arises 
that the cache will be able to fulfill a second demand for a page. Operating the 
lookahead cache in this manner would change the above argument for determining 
30 page queue length in favour of having a longer queue, since there is value in pre- 
fetching pages even if it takes several minutes. 
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With regard to the number of aquisition slots, at the simplest level then the more 
slots the better. If there are always free aquisition slots, pages can be fetched 
with the minimum of delay. 

5 In practice, a Unix machine will place a limit on the number of sub-processes 
permitted. Within this limit, a large number of sub-processes, over twenty say, 
can be run, since none uses much cpu (central processing unit) or memory 
resource. Most of the sub-processes' "lives" are spent simply waiting for data to 
become available. 

10 

If the lookahead load is more than one machine can handle, multiple machines can 
of course be used. 



An alternative to multiple sub-processes would be to have multiple threads running 
1 5 within the lookahead processor. This approach would require less operating 
system overhead and possibly operate more efficiently, but could make 
maintenance more difficult. The lookahead processor would then be implemented 
all in one program, rather than in separately maintainable parts. Reliability of the 
lookahead processor could also be compromised: the multiple sub-process 
20 arrangement is tolerant of failure within any of the sub-processes- such failures do 
not affect the lookahead processor itself which must after all run reliably and 
continuously. 

Referring to Figure 4, a flow diagram through the basic operation of the "look 
25 ahead processor" can be described as follows: 

STEP 400: The proxy server 105 provides a page to the user, either from its main 
cache or from the Internet, and instructs the look ahead processor 1 30 to handle 
the page by transmitting a message to the processor containing the URL for the 
30 relevant page. 

STEP 405: The look ahead processor 130 gets the URL's contents from the main 
cache 120 and parses the page's contents to determine the links to other pages. 
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(That is, it interprets the page's HTML to xtract information about the linked 
pages. This of course requires programmed-in knowledge of HTML syntax.) 
STEP 410: The existence of the child links so determined is tested against the 
main cache 120 and the look ahead cache 125. 
5 STEP 415: If a child link is not already cached, and it is not a page or a child page 
that is already being processed, it is added to the page's child list. 
STEP 420: If the page to be processed is determined to have any child links that 
need to be retrieved, the page is added to the head of the page processing queue. 
Each entry in the page processing queue 215 has associated with it the page's 

10 URL and, for each of the child links, a link URL and link status. This last will be 
selected from "ignored" if rejected by the link assessor 210, "done" if fully 
processed, "aborted" if timed out or a slot number if currently processing. 
STEP 425: If the page processing queue 215 has grown too long, indicating a 
processing bottleneck, the last page in the queue is removed, and any outstanding 

1 5 aquisitions associated with its children are aborted. 

STEP 430: An attempt is made to process each child of the new page, and any 
still unprocessed children of other pages in the page queue, by assigning them to 
inactive page acquisition slots. The slot filler 220 monitors the status of the 
aquisition slots 225, each of which can have a status of "free", "connecting" or 

20 "reading", and populates free slots from the page queue 215, starting with the 
first unprocessed link in the most recently added page. 

STEP 435: Newly-filled page acquisition slots are activated and a "connect 
processor" 230 is fired off as a Unix sub-process as described above. 
STEP 440: Any page acquisition slots that have spent too long attempting to 
25 connect, or fail for some other reason, are released and marked inactive, the slot 
filler 220 being notified. 

STEP 445: Any page acquisition slots that have successfully connected to servers 
135 are updated from a "connect" state to a " read" state. Reading is achieved by 
a read processor 240, using the same Unix sub-process as the connect phase. 
30 The slot processor 130 reads the relevant child link's data from the network and 
passes it to a cache writer in the cache controller 115. This writes the data to the 
lookahead cache 125 and notifies the shelf processor 265. 
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STEP 450: Any page acquisition slots 225 that have spent too long attempting to 
read from the servers are released and marked inactive, again notifying the slot 
filler 220 as in the connect phase. 

STEP 455: Pages that have been in the look ahead cache for too long are deemed 
5 unwanted and removed from the cache. This is practical since any files which 
have been accessed by a user after pre-fetching will have been transferred to the 
main cache 1 20 by a separate cache controller exercise. Although simplest to trim 
the lookahead cache 125 by regularly scanning for, and removing, outdated files, 
this approach consumes significant computing time and incurs high amounts of 
0 disc access. It is therefore preferred to use a shelf processor 265 as described 
above. 

The above process steps repeat indefinitely, although not necessarily in the order 
described. Clearly, steps 440, 445, 450 and 455 in particular can be carried out 
5 at a frequency found appropriate in relation to the rest of the process and these 
steps are shown in dotted outline to indicate they may not be present each time 
that the lookahead processor 1 30 is instructed to handle a page. 

Referring to Figure 5, a real time view of the system could be as shown. In the 
0 example, there are four pages 500 in the queue 21 5 and there are ten individual 
acquisition slots 505. Assuming that a new page (page 1 ) has just arrived, and 
that some acquisition slots 505 have just become free because processing of some 
children of page 4 has just completed, then some re-allocation of acquisition slots 
505 is needed. Page 2 has two of its children being processed. Its other two 
children are ready for processing but the arrival of the new page 1 may affect 
what will happen to them. Page 3 has four children processing, one connecting, 
three already connected and already being read. Page 4 is complete, all its 
children having either been read or aborted because they were too slow. 

The look ahead processor 130 will now assign the children of the newly arrived 
page 1 to slots 2, 6 and 7, and a child of page 2 to slot 8. Page 4 will be removed 
from the queue as it has no outstanding operations. 
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Referring to Figure 6, the results of the re-allocation can be seen. 

Referring to Figure 7, a slightly different version of the present invention might be 
found preferable, at STEPS 345, 350, where the system bypasses the lookahead 
5 processor 1 30 in the event that a page is found already in the main cache. This 
may be preferred if all pages have already been processed by the lookahead 
processor before loading to the main cache 120. 

As a consequence of the above variation, as shown in Figure 7, the system may 
10 move directly to trigger the lookahead processor 130, STEP 350, after transferring 
a page from the lookahead cache 1 25 to the main cache 1 20. In this case, at the 
same time as transferring the page to the main cache, the system will also have to 
supply the page to the lookahead processor 130. 

15 It would be possible to design embodiments of the invention in object-oriented 

technology. For instance, at the highest level, the three processors, the page, slot 
and shelf processors, can be regarded as objects. Each can be an independent 
entity, communicating with the others via messages rather than by direct data 
access or modification. At a lower level, the elements of the page queue and the 

20 aquisition slots have object-like features: each is an instantiation -of a prototype (a 
page queue element or an aquisition slot) and each has associated data and states. 

As described, Casper accesses all pages linked to a selected page. It would be 
possible to use the principles of the co-pending patent application referenced 
25 above and to select the pages accessed according to a user profile based on 
interests and context for instance. 



30 
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CLAIMS 

1. An information access system, for accessing information accessible by 
means of a communications network, the access system comprising: 
5 a) means for downloading items of information from the network to local 

storage; and 

b) an information processor for processing items of information to locate 

embedded links to other items of information accessible over the network; 

10 wherein said information processor comprises: 

i) a queuing arrangement for queuing items of information having such links 

embedded; and 



ii) 



a set of concurrently activatable information acquisition units 



15 the processor, in use, processing items of information to identify links embedded 
therein which identify information for downloading, and allocating identified links 
to respective available aquisition units, each aquisition unit then acting to 
download an item of information identified by a link allocated to it, from the 
network to the local storage. 

20 

2. An information access system according to Claim 1. which further 
comprises an input for requests with respect to items of information. 

3. An information access system according to Claim 2. wherein the local 
25 storage comprises at least two cache data stores, a first cache data store to which 

the aquisition units download identified items of information and a second cache 
data store for storing items of information identified in a request received at the 
input. 

30 4. An information access system according to claim 3, the system further 

comprising means for transferring an item of information from the first cache data 
store to the second cache data store in response to a request identifying the item 
of information. 
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5. An information access system according to any one of claims 2 to 4, 

wherein each request contains at least one location indicator, indicative of the 
location of a relevant item of information in the network, and the system further 
5 comprises a register for storing location indicators together with related constraint 
data, the system responding to a request at the input by accessing the register to 
obtain any constraint data stored in relation to a location indicator contained in the 
request. 

10 6. An information access system according to any one of the preceding 
claims, which further comprises queue length control means for deleting items of 
information from the queuing arrangement. 

7. An information access system according to claim 6 wherein the queue 
1 5 length control means deletes items of information which have been in the queuing 

arrangement for the greatest length of time. 

8. An information access system according to any one of the preceding 
claims, further comprising aquisition unit monitoring means for detecting when 

20 units become available and transferring links located in items of information from 
the queuing arrangement to such units. 

9. An information access system according to claim 8 wherein the aquisition 
unit monitoring means transfers links located in items of information in a priority 

25 order, the priority order being determined by the relative lengths of time the items 
have been present in the queuing arrangement. 

10. An information access system according to claim 9 wherein the highest 
priority is given to links located in the item which has been in the queuing 

30 arrangement for the least amount of time. 
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11. An information access system according to any one of th preceding 
claims wherein the queuing arrangement is arranged to queue each it m of 
information by storing in respect of it: 

a) an identifier for the item; and 
5 b) an identifier for one or more links embedded in the item. 

12. An information access system according to claim 1 1 wherein the queuing 
arrangement is further arranged to store status information for each of the link 
identifiers, relating to the download status of the link by means of an aquisition 

10 unit. 

13. A method of storing items of information accessible by means of a 
communications network, which method comprises the following steps: 

i) processing an item of information to locate one or more links to other 
15 items of information embedded therein, to be downloaded; and 

ii) downloading said one or more other items of information by means of said 
network to a local data store. 

14. A method according to claim 13 wherein said processing step comprises 
20 queuing the items of information by means of storing, in respect of each, an 

identifier for the item and an identifier for each embedded link to be downloaded. 

15. A method according to either one of claims 13 or 14 wherein said 
processing step further comprises allocating the embedded links identified in the 

25 queue for an item of information to respective aquisition units and downloading the 
items of information for the allocated links by means of the aquisition units. 

16. A method according to claims 14 and 15 wherein the processing step 
further comprises storing status information in respect of each identifier for the 

30 embedded links, indicating its status in respect of downloading by means of the 
aquisition units. 
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